Skip to content

Forks in python fuzzing and refactoring #2588

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
Sep 12, 2023

Conversation

tamarinvs19
Copy link
Collaborator

@tamarinvs19 tamarinvs19 commented Sep 11, 2023

Description

Fuzzing forks

  • Used forks in python fuzzing: now we can go back to previous annotation with history having.
  • Current strategy: try to go back to the best annotations per 12 attempts.
  • Current results (number of executions per second) is not worse then previous version on examples.
  • Suitable case: samples/controlflow/conditions.py. Here we can set a big timeout and cover all branches through returning to the previous annotations.

Execution counter

  • Added cli argument --execution-counter to save a number of executions. It can be helpful if you need to measure the speed of utbot python
  • Added some scripts in samples/testing_utils to collect and show executions information.

Code refactoring

  • Small cosmetic changes

How to test

Automated tests

Run run_tests_all.sh and check that all examples have expected coverage

Self-check list

Check off the item if the statement is true. Hint: [x] is a marked item.

Please do not delete the list or its items.

  • I've set the proper labels for my PR (at least, for category and component).
  • PR title and description are clear and intelligible.
  • I've added enough comments to my code, particularly in hard-to-understand areas.
  • The functionality I've repaired, changed or added is covered with automated tests.
  • Manual tests have been provided optionally.
  • The documentation for the functionality I've been working on is up-to-date.

@tamarinvs19 tamarinvs19 added comp-fuzzing Issue is related to the fuzzing comp-cli Issue related to CLI lang-python Issue is related to python support labels Sep 11, 2023
@tamarinvs19 tamarinvs19 self-assigned this Sep 11, 2023
Copy link
Collaborator

@Markoutte Markoutte left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tamarinvs19 tamarinvs19 merged commit 45e1d37 into main Sep 12, 2023
@tamarinvs19 tamarinvs19 deleted the tamarinvs19/python-fuzzing-refactoring branch September 12, 2023 07:30
tamarinvs19 added a commit that referenced this pull request Sep 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp-cli Issue related to CLI comp-fuzzing Issue is related to the fuzzing lang-python Issue is related to python support
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants